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Formative ^valuation of the First Thirteen Months of the SEDL/RX 

Susan F. Loucks 
_.~ Gene E. Hall 

/Procedures for Adopting Educational Innovations/CBAM Project 
Research and Development Center for Teacher Education 
The University of Texas at Austin 

November lA, 1977 

As a part of the involvement of the Research and Development Center for 
Teacher Education in the SEDL/RX, the CBAM staff have conducted an analysis 
and review of the activities of the SEDL/RX in its first thirteen months of 
operation. This analysis has been carried out in the fullest spirit of pro- 
cess or fomative evaluation. The objective of the evaluation is to sumnarize 
the activities of the first thirteen months, point out successes and problems, 
and make process recommendations to be considered by the RX Advisory Board and 
the SEDL/RX staff as they move into the next phase of RX development. 

In this report we explore the accomplishmentis, activities and some of the 
perceptions of the.RX at this time. We were particularly interested in developing 
a summary of what has been done to date so that it will be on the record. The 
RX is also at the point where decisions need to be made about the role, if any, 
of evaluation activities in the faturi. Further, it would seem that there must 
be some lessons that could be learned from taking a moment to reflect back on 
the intense activities of this past year. 

It is in this spirit of offering a catalyst for discussion and reflection 
as we plan next steps that this report is offered. Specifically, we have 
attempted to respond to the following questions: 

1) How has the SEDL/RX evolved and developed? 

2) I'rtiat have been the major activities at the SE7)L/RX? 

3) How have the Advisory Board members perceived the 
SEDL/RX and what do they see in the future? 

4) What can be learned from the SEDL/RX' s past that 
can positively influence its future? 



Methodology 

Due to the formative nature of this report, it was felt that all types of 
data could be considered in order to provide the richest picture possible. 
Thujs, varied sources of data were accessed, including: correspondence, trans- 
action logs, activity logs, field notes of meetings, and interviews with staff 
and Advisory Board members. These data are analyzed and described in the 
following sections. The report concludes with a description of several con- 
clusions, questions and recommendations. 



The Evolution of the SEDL/RX 
Trends in the Development of the SEDL/RX 

The SEDL/RX has evolved in little more than a year from five fully 
independent states, connected only geographically, with a U.S.O.E. Regional 
Office and an eductional laboratory, to a viable, information-sharing, service- 
oriented network uith enormous potential for growth. The development of this 
RX provides an interesting case study, since unlike other RX's in the country, 
this one started from "scratch" to develop not only information resources and 
training capability, but also to develop a sense of interstate collegiality and 
regionality. Much can be learned froin this evolution. 

Developing Concerns. Ongoing research at the Texas R&D Center for Teacher 
Education indicates that as persons become involved with something new, or a 
change, they experience "concerns" that can be described in predictable ways. 
These concerns tend to develop from initial "personal" concerns to concerns 
about the "task" at hand and, finally, to concerns about "imp-ict" on the 
clients to be affected by the change. This sequence of concerns can provide 
a useful frame of reference to contrast the development of the SEDL/RX from 
the perspective of both the staff and the members of the Exchange. 

In the course of the thirteen months of the RX, SEDL/RX staff members 
have exhibited appropriate and desirable changes in- their concerns as the RX 
has developed. These concerns have been reflected in the questions they have 
asked and the problems encountered. Although always concerned about meeting 
the needs^of the states, . early-on personal and task concerns were a part of 
the staff's environment. Initially the questions being asked included: UTiat . 
is my role? Will I ev^r learn all I need to know? lihat is the R&D Exchange, 
and how do I fit into it? Vr.at promises can we make that we can be certain we 
can keep? Later, concerns about the task of setting up and managing the RX 
predominated: How can we make the best use of our allotted linker training time? 
How many people can we financially service? Will the information service activity 
be accomplished and/or contracted (i.e.. Will I ever find the time to finish 
those searches?)? How can state and NIE needs, \v?hich often conflict, all be met? 
Gradually, as these self and task concerns became less intense, questions that 
wore primarily client- (i.e., state) oriented became more intense: How can we 
meet the immediate individual needs of states as well as develop the regionality 
that has the potential of meeting even more needs in the future? How can we be 
certain v;e know exactly what information people are seeking so we can be more 
certain of locating it? How can RX activities be interfaced with other regional 
SEDL thrusts so as to have greater collective impact? 

As RX staff members' concerns have changed, so too have the concerns of the 
members of the Exchange, the five states and OE regional office. Questions and 
concerns expressed at early Advisory Board meetings included: How Is this "one 
more NIE effort" going to affect my state? What services can the Exchange pro- 
vide, my state? ^ow much of my time and the time of my colleagues within my state 
will be taken by this effort? As the roles of both member states and SEDL be- 
came clearer and early concerns were resolved, questions being asked at meetings 
focused more on organizing and managing of the actual activities of the Exchange: 
How many people can 1 send to the workshop? When can we start sending search 
requests? How can RX staff visits to states be arranged? In the last month, 
member concerns have changed to a focus on impact of the Exchange on a broader 
portion of users of R&D products within RX states: How can workshops be 
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individualized such that more needs within each state can be met? How can the 
KX help us take advantage of other federally-sponsored projects, activities 
and events that will meet some of our other needs? H o w can we make more people 

-la our states aware of-and 'geEISoFe out of"WC activities? 

.pm ^i^^iPS Ownership. Initially, the^ly-owner-^-ltheH«^as-the grantee . 
rr One very important goal was to gain ownership by each of the states and 
the Oh office, most of whom were likely to be suspect of a loosely-structured, 
unspecified federal project with money allotted directly to a federally-estab- ' 
lished institution. One way SEDL sought to establish regional ownership was 
by being highly responsive to state needs, by catering as much as possible to 
the requests and preferences of the states organizationally and substantively. 
Thus, a reactive- rather than a "proactive" mode was operationalized, sometimes 
to the disapproval of the funding agency. It is worth noting that this "clients 
tlrst perspective has not been as strongly emphasized in other Regional Exchanges, 
ihe result has been an RX that most Exchange members consider to be responsive to 
their needs. 



Developing ParticipaUon. Particularly during the planning period, but also 
well into the operational phase, one person from each state, one from the OE 
office, and S^^DL/RX staff members "were" the Regional Exchange. Since then, 
however, through participation in RX-sponsored workshops and accessing the infor- 
mation resources provided by the RX, many more individuals from all states have 
become involved in Exchange activities. Broadening the participant base has not 
only resulted in more people being aware of the RX and realizing its usefulness, 
but also has provided a broader constituency base to insure its continuation. 
A further effect is that the individuals have formed their own informal networks 
and are establishing new lines of cosmunication, both within and without the RX. 
Linking people has becone an important outcome and is one characteristic of an 
ideally functioning Regional Exchange. 

Developing Resource Base. Initially, RX staff were linked to a relatively 
undefined R&D Exchange network with fow other linkages. As the RX has developed, 
it has built linkages to many potentially useful resources, both within and 
outside of the RX region. Ongoing contact is maintained with the Texas CITE 
Project, the Linkage Training Service, the national RDX contractors, and with 
the numerous ERIC Clearinghouses. Knowing who-to-call-when is a vital capability 
for any service-oriented organization, and such a capability is rapidly developing 
wirhln the SEDL/RX. More specific information about outside contacts is given 
later in this report. 

SEDL/RX in Relarion to Other Projects 

In addition to developing and strengthening ties with each of the five 
states of the SEDL/RX, the project is in the process of clarifying its role and 

complimentarity" with the developing regional emphasis of SEDL as a regional 
educational laboratory. As the lab expands and clarifies its larger roles with- 
in the region, the RX offers a potentially exciting arm for communication and 
dissemination of R&D outcomes, products, and services from SEDL and elsewhere. 

The SEDL/RX is also tied to the other Regional Exchanges and the national 
contractors. As each of these projects further clarifies and develops its own 
capAbilities, there should be increased opportunity for cross RX sharing. 
Further, it is hoped that the national contractors will play a more visible role, 
since to date it appears that the SEDL/RX is servicing these contractors signi- 
ficantly more than they are servicing this Exchange. 



ERIC 



/ 



I 



Major Activities of the SEDL/RX 

Key Eveats nnd Activitie s 



-Afvf>e«d4x-A-eotvtiH.n«-^-«ri^ndtir-^^^ and activities of 

the SEDL/RX from the funding of the planning period (October 1, 1976) through 
the middle of November 1977; Basically eight kinds of activities ensued: 

1) Advisory Board meetings (4 full-day meetings and one part-day meeting) 

2) Participation in national R&D Exchange activities (5 meetings raneine 
from 2 to 4 days) 

3) Baseline data collection involving on-site visits to all states and 
the OE regional office 

A) Linker training need-sens ioE visits to 4 states 

5) Dissemination linker training workshops involving all states and the 
regional" office 

6) Information service visits to three states 

7) The National Dissemination Forum occurring the week of -June 20, 1977 
And most recently, servicing information requests from the SEDL/RX 
states. 
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Detailed information about these activities can be found in the SEDL/RX quarterly 
reports.. 

Analysis of Trends in Activity and Contacts 

Major ingredients in the SEDL/RI-: are the contacts and other networking 
activities participated in by the SEDL based staff. The R&D Exchange has estab- 
lished procedures for docu.tar.tins activitiei? ' ar.d contacts in the form of (1) 
transaction log.s for explicating major contacts and (2) interaction logs for 
keeping track of every contact made by RX staff. For purposes of this evaluation 
an effort was made to compile and categorize the activities and contacts reported 
on both these forms and documented in the outgoing correspondence of the SEDL/RX. 
This information provides a picture of the nature of these contacts and with whom 
they have been made. 

Figure 1 displays contacts made by and with the RX by means of phone, 
meetings, and workshops and letter and other mailouta. Several trends are indi- 
cated by this chart: 

1) The RX has participated in a wide variety of activities and, within 
each activity, contacts have been made with a wide variety of institu- 
tions and individuals. 

2) The amount of activity has increased considerably from May 1977 when 
these logs were first kept. 

3) The variety of contacts has also increased as new sources for infor- 
mation and resources are discovered and as the SEDL/RS has become a 
resource for others to draw upon. 

4) The phone has been the primary source of contact. This is particularly 
important since it allows for immediate and interactive communication 
of and response to needs as well as contributing to the interpersonal 
contacts and rapport-building vital to the RX effort. 
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Figure 1: Contacts Made By and With the RX . 



SEDL/RX Activities 



SEDL/RX_Re^iest.X or Information 



RDX 

Ark_ 
La 



SEDL 

cite" 



ERIC 



RISE 



Phone 



May 



June 



Stanford 



O uv't. Agencies; 
CKPM 



i "»t. for Devt. of Ed. A c t . 
MAILS 



NT L 

Tx RRC 

AEL/RX 

NWRL/RX 

NIE 

Mlsc, 



Request for Information, 
Searches o f S EDL/RX 
Okla 



0E_ 
TEA 



G reg Benson 



AEL 



North Carolina 



jiLEL}S£.^--Iral_ ning Need Se nsing 



LIS 
Tx 

ERLC 
'i ' 



Page 1 of 3 
(Figure 1 cent.) 



July 



Aug 



Sept 



Cot 



' 2 



Meeting & Workshop 



May 



June 



July 



Aug 



Sept 



Oct 



Letter & Mailing 



May 



June 



July 



Aug 



Sept 



Oct 



1'^ 



SEDL/IOC Activities 


Phone 


Meeting & Workshop 


Letter & Mailing 




May 


Juno 


July 


Aug 


Sept 


Oct 


May 


June 


July 


Aug 


Sept 


Oct 


May 


June 


! July 


' Aug 


Sept 


Oct 


Okla 
Ark 

la 


2 
1 
1 




1 










1 


1 












1 








NM 

Linker Training Workshops 
Advisory Bd. 
UTK&D 
ROX 

LTS " ' 
fx 

Ok la — 


1 




1 
2 

< 2 
2 


1 




3 


— 




2 

1 
1 


3 


1 
1 


1 
1 






1 

1 


2 
1 






NM 
Ark 
01- 
La 

Texas Workshop 
LTS 
TKA 

J.X Service: Conter 


— , — 1 




5 
6 


2 
1 
1 
1 

3 
2 

r 1 




'i 

1 
1 


— 








1 
1 
1 
2 
1 


1 
1 
1 
1 
1 




- 




1 
1 
1 
1 

1 






Okla 

Or. M. Taylor 

Information Resources Need- 
Sensing^ 

NM •• * 

Ark 






1 
1 


2 
1 

2 






— , 








1 
















dkla 

Sharing of Information 
Advisory Board 
NM 
AKL 

U&U Community (Newr. letter ) 
NWKL/RX 






2 

1 J 


1 
2 












1 


1 




1 




1 
1 
1 




2 


1 j 
1 


' La 

OK 

Okla 
Ark 

Pa>',u 2 of 3 
O (Figure 1 cont.) 

ERLC 11 










1 


3 






















1 
1 
2 

1 


ON 

'4 



SEDL/RX Activities 


Phone 


Meeting & Workshop 


Letter & Mailing 




May 


June 


July 


Aug 


Sept 


Oct 


May 


June 


July 


Aug 


Sept 


Oct 


May 


June 


July 


Aug 


Sept 


Oct 


Conununication with RDX Systems 
Contractors for Svstem Business 
































• 

2 






LTS 

Communication with N'lE 








c 

1 









• 




1 












1 






Internal ConununlcaMnnc 






































H^jmning. Proposal Writing 


















6 


21 










1 








Evaluation 
with UTR&D 


1 






2 










1 






1 




























2 


1 


3 


1 






3 






1 









Page 3 of 3 



/ 



6 



ERIC 



8 



5) There are gaps in the information recorded that are obvious 
to individuals vho have participated in a major part of the 
RX activities. For example, the five Advisory Board meetings 
were not recorded consistently on activity logs, yet are a 
vital aspect of the RX. It would be impossible to trace these 
occurrences, attendees, etc., by referring to the logs, although 
using activity logs for such documentation could provide an 
easily accessible source of this kind of information. More 
cousistenc and compulsive use of the activity log adapted by 
SEDL/RX staff from RDX .nteraction logs is recommended. 

6) Nowhere in the SEDL/RX files can be found detailed descriptions 
of the content of phone calls, which obviously are the most 
important tool used for contacts. Copies of letters are kept, 
but only short statements are made about phone calls on activity 
logs, which is insufficient to understand the content of a 30- 
minute interaction. It is recommended that each phone call be 
recorded systematically and consistently. Appendix B illustrates 
a phone call record format that might be used or adapted to 

meet this need. Keeping these forms handy, perhaps on a clip- 
board 'under the phone, would effectively meet this need. 

/v nalysis of the Frequency of Outgoing Correspondence 

A separate analysis was made of outgoing correspondence. Project record 
keeping procedures include placing copies of outgoing correspondence in a 
notebook in chronological order. ' Flgurc-s 2 and 3 are summaries of the outgoing 
mail. Figure 2 proviJas a breakdo'o. of oucgoing nail by target and frequency 
per month. In Figure J, the frequency or correspondence by different project 
staff are summarized. The following interpretations of these data are offered 
for Figure 2: 

1) There has been regular and. frequent (every 2 to 3 weeks) . 
written contact with the Advisory Board as a group. 

2) Each of the membe;rs of the Advisory Board have additional 
individual written contact, with Cutter, Carpenter and 
louisiana having the most. 

3) In the last three months, correspondence with state staff, 
other than Advisory Board members, has increased signi- 
ficantly. This is further indication of the broadening 

of the membership of the network. 

4) Lab/center contacts appear to increase and decrease with 
proposal writing times. 

5) J There is monthly x/ritten communication to NIE. 

6) ( Staff requests for information sources began in March, 
\peakcd in May, indicating long lead time in anticipation 

of information requests. 

7) The return of information in response to requested searches 
began in October. 

Interpretations based on Figure 3 include; 

1) The cotal rate of correspondence per month is surprisingly " 
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Figure 3. Frequency of Outgoing Mail by Staff Pers 
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consistent. There is not a regular increase with the 
addition of staff or operationalization of the project. 
2) Outgoing correspondence increases at proposal writing time. 
"'^ As Sharon and Jan joined the project and have taken hold, 
they are sending more correspondence, while Preston's 
share" has decreased. 
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Analysis of thti Content of Corresp ondnnrp 

The analysis of the content clearly indicates that the staff use corre- 
spondence ta confirm decisions and actions taken through phone calls, meetings, 
visits, and workshops. Clearly, any closer analysis of the resource costs 
re ative to project activities will require much better documentation of phone 
qalls and meetings. . 

This result is not surprising. Past documentation at the Texas R&D Center- 
has demonstrated that active projects and the most active field sites will use 
the telephone primarily with much less excharige of correspondence. Documenta- 
tion is more of a problem, however, since active field staff do not- easily 
find ti;ne to document their interactions. 

Although the frequency of correspondence has remained about the same, the 
content has shifted from Drs. Perry and Kronkosky in early policy level and 
project development correspondence to the more recent information services 
correspondence of Sharon Adams and the workshop correspondence of Jan Schechter. 

' Reactions ox Participants ' 

Advisory Seward zier-bers were asksd to reflect on how they perceived the RX 
to have developed over time. Four areas of questions were asked of each of the 
six Advisory Board members through* interviews conducted in the last week of 
October. These questions were; (1) How do you see the RX has developed over 
time? (2) What were the strengths and weaknesses of the project in the last 
six nonths? (3) What would you like to see for activities in the next six months? 
(4) What are your long-term (3-5 year) visions for the SEDL/RX? 

The Development of the Exchange 

In the responses to the first question, two trends were identified: 

1) At first, SEA representatives were skeptical about the RX, 
wonderinjg whether it would be duplicating current efforts or 
whether their participation would be simply a way of keeping 
people in business, i.e., funded, rather than having the po- 
tential to truly meet some needs. Over time they have come to 
have confidence in and respect for SEDL, as indicated by their 
willingness to continue participation and to involve others 
from their states. They feel the potential is there for a 
real regional role with greater capability than can be found 
in any single state. 

2) There has also been a noticeable development in SEDL/RX staff, 
from lacking confidence in their abilities to both conceptualize 
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the role of the RX and 'to significantly contribute to 
meeting the dissemination needs of t.he states. Gradually, 
this confidence has increased as has the capability to 
meet state needs and broker services and infornvation. 

Strenp^ths of the Exchan p,e 

Responses as to what were seen as the strengths of the RX were: 

1) Willingness of SIIDL/RX staff to be flexible in changing when 
asked, to listen, and to be responsive both to the desires and 
needs of each state. This Includes the early establishment of 
parameters, such as that the RX would deal directly with SEA's 
only, in addition to acknowledging the individual problems and 
concerns with respect to each state's dissemination capabilities. 
Increasing the states' access to materials, such as the compila- 
tions of CBE and reading resources, and providing information 
about national events, such as the' White House library conference 
and the 1980 census, which might have gone unnoted otherwise. 
Giving the states the opportunity to focus in on their own 
dissemination needs, develop a model and implement it with 
■ guidance. 

4) Providing impetus and funding to attend the Dissemination 
Forum in June and the workshop sessions to broaden the knowl- 
edge base of all participants. 

5) Affording the opportunity for states to be connected with 
others and with other organizations who can be brought in 

to provide specific services, training, and resources. Estab- 
lishment of a network. 

6) They are "delighted" with the searches that have been done by 
RX staff. ' 

7) Provides a back-up for surh state projects as information 
services and dissemination grants. 

8) Tl\e NIE catalog index has been very useful. 

V/e nknesses of the Exchan f *e 

When asked to describe some of the weaknesses of the Exchange, one member 
could not think of any, .Other members gave a variety of responses: 

1) The problem of working within a region is that no two states 
will have the same needs. The membership on a board such as 
that of ^ the RX may change, and so trying to keep continuity 
and progress is difficult. This is an. inherent problem, 
though, rather than a weakness in this particular effort. 

2) One problem two persons mentioned was that the participants 
themselves were guilty of letting the SEDL/RX staff essentially 
do everything: set everything up, generate most of the ideas, 
etc. They felt they themselves should be more proactive rather 
than reactive, should be more creative and assertive. One 
noted, on the other hand, that states have not been asked to 
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contribute in this way, and so they have not. 
3) One person noted that the Exchange has not yet generated a 
suffjicient action program. Not enough conceptualizing has 
been; done as a group to generate ideas that could be acted 
upon. 

^) Anot'iher mentioned that the RX has aot "piggy-backed" enough 
on ejxisting dissemination efforts such as NDN and so has 
maintained a rather narrow focus. 

5) There has not been enough concentration on content within the 
RX. This wpakne^p was reflected on by another individual who 
suggested there yjas not enough substantive input from the 
Advisory Board. ' For example, they should have been consulted 
about workshop content, format, and consultants. 

6) The lack of "flow-through" ^money is seen by one individual 
as a weakness (i.e., money that is passed directly on to 
the state to use as they see fit). Thus, states lack any 
real control of the RX. 

7) One individual noted that there is much restriction imposed 
by NIE. For example, the RX does not have the freedom to 
provide training by persons outside of NIE contracts. They 
should inscend be abl.e to broker any services that a specific 
state needs. 

8) Two people suggested that the last linker training workshop 
fell short of the expectations of the participants, that it 
did not address their- needs as directly as' desirable. 

9) Two states ir.dic-t^id that if thay ther.selves could "get their 
act togeuhar" more, they would be more able to take advantage 
of what the Rl'l h?.s to offer, this is not a criticism of the 
Exchange but a realization that they themselves are not making 
the best use of it. 

RecQmmendatlons f or Change 

• Respoudentrs were asked to recommend changes in how the Exchange is 
functioning: 

1) Several respondents suggested that there be more opportunities 
for sharing across the states. This could be done by each 
state sharing product listings, descriptions, brochures, etc., 
that reprtjsent promising practices within the state and 
resources that can be accessed by others. This could also be 
done through ,a regional Dissemination Forum, still in the 
planning, which will allow all professional disseminators of 
each state to convene and sha*re ideas and concerns, as well as 
develop more communication and linkages. 

2) An effort should be made to integrate SEDL/RX activities and 
goals with other regional SEDL efforts. 

3) The Exchange should establish more contact with information 
resources like ERIC. The proposed contracting with the Texas 
CITE Project is a positive step in this direction. 

4) In instituting the feedforward function^ the R&D Exchange, as a 
whole, should recognize that research and development is performed 
at both SEA and LEA levels as .well as in outside R&D institutions. 



Some funds should be funnelcd directly to states and then 
to lea's to do "action research." In addition, feedforward 
interviews should not only assess what use is being made of 
R&D products but also what .-caearch and development Is 
actually being done. 
5) Thoru is some inconsistency among states as to whac would 
be the best "next step" in terras of training. Some make a 
case for workshops specific to each state's need being con- 
ducted in that state so more peoplt; can participate. One 
mentioned wanting all people x^ithin the state in day to day 
contact with teachers to be involved. Another suggested the 
need to take the state's dissemination plan developed at 
previous workshops and operationalizc it. On the other hand, 
another state indicated .the need for contact with others for 
sharing and linking new ideas and processes rather than extensive 
training specific to the state. A compromise suggestion was for 
individualized training followed by a regional conference or 
workshop where states could share their progress, and insights. 
Another suggnstion was to adopt the concept of the regional seminar 
where a carefully selected delegation from each SEA would visit 
other states to receive one-to-one information about what is 
being done in dissemination. 
7) Having an inward WATS line to the SEDL/RX would facilitate and 
encourage communication and requests and increase the accessi- 
bility oi services to an expanded number of individuals. 

yj/ ^.tons for tihi Future 

Me:nbers of the Advisory Board were asked to reflect on their vision for 
the future role of the Exchange. Responses included: 
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1) Making the RX fully operational including continual need- 
senaing and offering of services. 

2) Additional growth in back-up to state information services, 
particularly In compiling both lists of R&D materials, and 
a resource center with sample R&D materials. 

3) An ongoing and continually updated "promising practices" 
exchange for the five states. 

4) Assume a linking role in making it possible for some states to 
contract to share resources that have already been developed in 
other states. 

5) The Exchange could link SEDL research capabilities with the 
states so as to increase their capabilities in this area. 
One individual envisioned that, partially as a result of RX 
input, five years from now each state would have recognized 
individuals in the roles of facilitators and linkers x^ho would 
be knov/ledgoable of how research and development could be 
disseminated and implemented. T|ie emphasis of these individuals 
would be on improvement of services to children. This could be 
the result of a regional network with the RX as a nucleus 
bringing the operating components together to form a cohesive 
whole . 
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Conclusions, Questions and Recdauaendaclons 

Based on our observations over the last year and a half, participation 
in most events, analyses of the existing notes and records,, and interviews 
with the SEOL/RX Advisory Board, the following conclusions, questions, and 
recoimnendatlona are offered. As we expressed at the beginning of this 
report, this is designed and intended as a formative study, and the following 
discussion is intended to stimulate further discussion and processing as the 
SEDL/RX moves into a. new operational phase. 

Conclusions '\ 

1) Through the combined efforts of key staff from one regional lab and 
five states with funding from NIE, an R&D Exchange has been established. The 
SEDL/RX has made an impressive start and has solid enough footing so that all 
of. the states have stayed with the project and are looking toward its future. 

2) The early goncerns of the staff and the states have been reduced 

and concerns about impact have greatly increased as a result of the successful 
beginning steps. 

3) The states are dramatically diverse in their needs, dissemination 
sophistication, and politics. Due to the client-centered orientation of the 
project staff, each state, at least in part, has been able to gain from the 
project, 

4) Due to the confidence of the Advisory Board members in themselves 
and their SEA colleagues, they have encouraged the involvement of other SEA 
staffs in. the RX which is greatly increasing the RX's potential. 

Questions; * 

We do ha\e some questions of the RX staff and the Advisory Board that they 
might wish to consider. We know some of these are talked about, but definite 
answers are needed quickly. 

1) What, if any, evaluation activities should be incorporated into the . 
project? At present, it would seem that formative evaluation data would be 
most helpful in designing and conducting future activities. However, at some 
point, summative evaluation questions will need to be addressed. 

2) What are the near future and 3-5 year goals and objectives for the 
SEDL/RX? From interviewing project staff and Advisory Board members, it does 
not appear that the future goals are too clearly formulated or that there is 
a common understanding of these. 

3) What is the relationship of the SEDL regional emphasis to the 
Sr;DL/RX? It appears that there could be a great deal of stumbling over each 
other if these activities and staff roles are not carefully thought out and 
coordinated. 

Recommendat ions 

Since we are among colleagues and are participants in the SEDL/RX, we 
would like to make several recommendations thaf. we see as needing attention: 
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■•L • The role of the AJ visory Board need.q to shift to being more of a 
conceptunl and planntng body\ 

Until now it has been crucial to success that the SEDL staff take 
major responsibility for defining tasks and setting dircjctions. Now, the 
Advisory Board should begin to shoulder some of this responsibility. The 
states are very different, attending to each one and every one is going to 
be a difficult and, at times, an impossible goal. Rather than the SEDL staff . 
having to shouldi^r this responsibility by themselves, it should be shared. 

2 • Documcntat Log of p roject actlvitfes, especially phone calls and 
meo Lings, needs to be done . 

If there is to be any future formative/process evaluations, then more 
systematic data are required. Given the present documentation activities, it 
is not possible to fully understand or describe the allocation of resources or 
project activitieii. Future studies Would be no more meaningful than this one 
and certainly will not provide the basis for addressing summative/product/ 
outcome questions. 

Incidentally, assuming that other RX projects have the same level of rigor 
in their documentation activities, serious questions can be raised about the 
reliability and validity of findings reported out of the- data being collected 
at the Far West L^b. 

'3. The SEDL/RX nQejs to hocomj^ tnuch more explicit and imaginative in 
o utlining its long ran^je -^o-^Ls . 

Up u^til not; th.e project scaff and the Advisory Board have had their 
energies consur;ed in making the system operational. During this year, they 
nfied to take the time to brainstorm alternative futures and develop consensus 
on their intermediate and long term goals. Without better goal clarity, the 
lab staff cannot effectively allocate limited resources, and without goal 
clarity, all of the states with their many different needs and characteristics 
will not be satisfied with the outcomes of the iUC activities selected. 



Much has been accomplished in a very short time with limited resources. 
It takes competent and conmiitted professionals to establish a seven-agency 
inierntate cooperative in a year and a half. All are to be congratulated on 
t\w amazingly successful start. The challenge is now to address, anticipate, 
and manage the future directions of the project, not to become a victim of it. 



Or: 
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Appendix B 
• PHONE CALL RECORD 



DATE ^ 'YOUR NAI1E. 

NAME OF PERSON 



SITE 



□ I MADE CALL. \ □ I RETURNED HER/HIS CALL 

□ I RECEIVED CALL □ s/HE RETURNED MY CALL 



PURPOSE: 1. 4. 

2-_ ' 5, 

3. 6. 



GENERAL TONE OF CONVERSATION 



